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Abstract 

A discrete-time model reference adaptive control scheme is developed for trajectory track- 
ing of robot manipulators. Hyperstability theory is utilized to derive the adaptation laws for the 
controller gain matrices. It is shown that asymptotic trajectory tracking is achieved despite gross 
robot parameter variation and uncertainties. The method offers considerable design flexibility 
and enables the designer to improve the performance of the control system by adjusting free 
design parameters. The discrete-time adaptation algorithm is extremely simple and is therefore 
suitable for real-time implementation. 

1. Introduction 

It is recognized that adaptive schemes are effective means of robot control due to their abil- 
ity to cope with the highly nonlinear, coupled and time-varying characteristics of robots. This is 
specially true in the case of direct drive robots and light weight manipulators where inertia 
changes and gravity effects are significant. Research efforts on adaptive control of manipulators 
have been concentrated on developing continuous-time control schemes [e.g. 1-9]. In practice 
however, robots are controlled by digital computers on discrete-time basis. Digital implementa- 
tion of a solution based on continuous-time formulation can result in degradation of performance 
and the closed-loop system can even become unstable, especially when the sampling time is not 
small. Even if the sampling time could be made sufficiently small, digital implementation of a 
discrete-time adaptive scheme is more direct and straightforward. 

In this paper, we develop a discrete-time model reference adaptive control scheme for tra- 
jectory tracking of robot manipulators. The present approach differs from the previously pub- 
lished results [e.g. 10-12] in that the discrete-time adaptive control is developed on the basis of a 
general coupled robot model, without linearizing the model or assuming negligible interactions 
among robot joints. Furthermore, instead of the conventional Lyapunov approach, hyperstability 
theory is utilized to obtain the adaptation laws. The use of hyperstability theory is more appealing 
than the Lyapunov approach since it is better suited to discrete-time systems and also offers more 
flexibility in design by providing additional free design parameters. These parameters can be 
adjusted by the designer to improve the response. Finally, the proposed discrete-time adaptive 
control algorithm is extremely simple and computationally fast, and is therefore suitable for real 
time digital control of robot manipulators. 
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2. Discrete-Time Robot Model 

The equation of motion of an n -joint robot manipulator carrying a payload of mass m can be 
written as [4,9] 

B 2(0,0, m ) 0 + B jCe.e^i ) 0 + B o(0,0,/n ) 0(0 = u (f ) ( 1 ) 

where 0(f) and u(t) are the nx 1 joint angle and joint torque vectors respectively, and B 2 Q, B,(.) 
and B 0 (.) are n xn matrices whose elements are complex nonlinear functions of 0(r ) ,0(f ) and m(t ). 
Since 0(r) ,0(r) and m(t) are functions of time, (1) can be expressed as 

B 2 (f ) 0(f ) + B i (r ) 0(f ) + B 0 (f ) 0(f ) = u (f ) (2) 

where B 2 (t) = B 2 (B,Qjn), B \(t) = B and B^t) &Bo(Q,Q,m) are nxn time- varying robot 

matrices. 


Suppose that the robot is controlled by a digital controller. The inputs to the controller are 
the reference trajectory represented by the nxl vector B r (k) and the actual joint angle vector 00k), 
where Q r (k ) and Q(k) are obtained by sampling 0 r (f) and 0(f) at equally spaced time intervals T. 
The output of the digital controller is the vector u(k), and is passed through a hold circuit to 
obtain the continuous-time signal u(t ) where u(r) is constant over the time interval (k-\)T<t<kT . 
In order to obtain the equation relating 0(*) and u(k), we must discretize the robot model (2). A 
simple method of discretization is by using the approximations 



0(/k)-00k-l) 


Substituting (3) into (2), we obtain 


0(0 = ^-0(0 = ~ 0(*)-20Ok-l)+0Ok-2) 


(3) 


A 2 (k ,T ) Q(k -2) + A 1 (k,T)Q(k-\)+A 0 (k,T)Q(k) = u(k) 


(4) 

2B 2 (k) Bi(k) B 2 (k) 

— —z — and A(£k,T) = B 0 (k) — — + — — are nxn 


. B 2 (k ) B,0k) 

where A 2 (k ,T ) = — , A x (k ,T) = — — — 

T * A a £ 

matrices, and B 2 (k ) ,B { (k) , B 0 (k) are the values of B 2 (t ) , B ,(r) , fl 0 (f) respectively, evaluated at 
time t=kT . Note that A 2 (k,T ) is a symmetric positive definite (SPD) matrix since B 2 (t) is always 
SPD [13]. Equation (4) is an accurate discrete-time representation of (1) provided that T is 
sufficiently small so that (3) can be used. 


For exact discretization, we must find the response 0(f) of the continuous model (2) at time 
t=kT and equate it with the response Q(k ) of the discrete model (4), [14]. This will ensure that the 
two models describe the same robot motion at the sampling times t=kT, k= 0,1,2,.... Although this 
procedure provides structural information about the robot discrete-time model, it is extremely 
complex and will not be pursued here. 

In the analysis to follow, we assume that the equation of the robot with a sampler in its out- 
put and a hold circuit in its input can be described by the discrete-time model (4), where A 0 (k,T) 
is invertible and the robot matrices are unknown. Since the sampling period is constant , we drop 
it for convenience and write (4) as 


A 2 (* ) 0(* -2) + A J (* ) 0(* - 1 ) +A o(Jk ) 0(Jt ) = u (k ) 


(5) 


3. Adaptive Control Scheme 

In this section, we describe a method for the design of discrete-time adaptive controllers for 
the robot model (5) such that the robot joint angle vector B(k) tracks the reference trajectory 
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vector 0 r (Jt) despite variations in the payload and unknown robot model parameters. 

Let the n xl joint angle error vector be defined as 

8 £ (*) = 0 ,(*)- 0 (*) ( 6 ) 

Substituting (6) into (5), we obtain the equation of the joint angle error as 

0 e (k) = A o' -u (k )-A , (k ) 8 e (k -1 M 2 (k ) 0, (k -2)+A 0 (k)Q r (k )+A l (k)Q r (k-\)+A 2 (k) Q r (k -2) (7 ) 

Equation (7) suggests that in order to completely influence the joint angle error, we require a con- 
trol law of the general form 

u (k ) = P j (k ) 8 e (k - 1 )+P 2 (k ) 0 , ( k -2 )+Q o (k )d r (k)+Qi(k)d r (k-l)+Q2(k) 0 , (k -2) (8) 

where P x (k), P 2 (k) are time-varying feedback matrices acting on the joint angle error, and 
Qo(k)<Q\(k),Q 2 (k) are time-varying feedforward matrices acting on the reference trajectory, all to 
be determined. Note that the discrete-time control law (8) is analogous to the continuous-time 
control law using position-velocity feedback and position- velocity -acceleration feedforward [9]. 

Substituting (8) into (7), we obtain the joint angle error equation for the closed-loop system 

0 e (/fc) + V P \(k)+A i(&) Q e (k-\) + AS'[p 2 (k)+A 2 (k^ 0 t (*-2) (9) 

= Ao'[A 0 (k)-Q 0 (k^ 0 r (*-l) + V[^2(*H2 2 (*)] Q r(k-2) 

Suppose that the desired performance of the manipulator is represented by 

Q em (k) + C,0 £m (*-1) + c 2 0 em (k- 2) = 0 (10) 

where Q em (k) is the nxl joint angle error vector of the reference model and C U C 2 are constant 
nxn matrices chosen such that joint angle errors are decoupled and decay with time. In the model 
reference adaptive control terminology [15], equations (9) and (10) describe the adjustable sys- 
tem and the reference model, respectively. For decoupling of the joint errors , we choose 
C i=diag {c u } and C 2 = diag(c 2i }, i=\,2,...,n. In order that the errors decay to zero, the roots 
A.i , , of the characteristic polynomial A(z) of the reference model (10) must lie inside the unit 

circle in the complex z -plane, where 


A (z)={/„z 2 + C,z +C 2 / = n8,(z) 
' ' ;= i 

(Ha) 

and 


8,(z) = z 2 + c ll z +c 2l = (z+X u )(z+’k 2l ) 

(Hb) 

Thus the diagonal elements of the matrices C i and C 2 are 


c W = i c 2< = ^-li^2i > i=l,2,...,rt 

(11c) 

where 1 A u 1 <1 , 1 ^ 1 <1 for the stability of the reference model. 
The solution to (10) is 


B em (^) = <I> ffI (/:)0 £m (O) 

(12) 


where O m (k) is the transition matrix of the reference model (10) and 0^(0) is the initial value of 
the reference model. If Q em (0) is chosen to be zero, 9 sm (k) becomes identically equal to zero, i.e. 
Q em (k) = 0 for all k> 0 , due to the stability of the reference model. The objective is now to devise 
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an adaptation scheme such that the robot joint angle error dynamics B e (k) governed by (9) 
approaches that of the reference model dynamics (10) in which 0 <m (*)==O. In order to achieve this 
objective, we define the deviation between the ideal and the actual errors as 


e(k) = Q em (k)~ B e (k) 

Combining (9), (10) and (13), we obtain 

e(£) + Ci e(£-l) + C 2 e(it-2) + H'Ofc) = 0 

where 

w (k ) = [ C , - >1 o 1 1 (A i(* )+P i(k )) 0 e (k -1 ) + [ C 2 - A o' 1 (A 2 (k 2 (k ))j 0 e (k -2) 

+V[^o(*H2o(*)] 0 r (A: ) -»- >1 o 1 [a i(A: )-<2 1 (*)] 0 r (*-l) + A^A 2 {k)-Q 2 (k) 
= w i (k) + w 2 (k) + ■ ■ ■ +w 5 (k) 


(13) 

(14a) 

(14b) 


e r (*-2) 


The adaptation problem is to find the feedback gain matrices P\(k), P 2 (k) and the feedfor- 
ward gain matrices Q 0 (k), Qi(k), Q 2 (k ) such that the adaptation error dynamic (14) is stable, i.e. 
e(k) approaches zero asymptotically. If this is achieved, the joint angle error vector Q e (k) 
becomes equal to the reference model error vector 0 em (A)=O, implying that Q e (k)= 0, hence 
0(A)=0 r (A) and trajectory tracking occurs. 


The state-space representation of (14) is 



' 0 /„' 

'e(k-2j 


0 

l e(k) J ~ 

—C 2 “Cl 

fc J 

U(*-1)J 


C J 


(15) 


Now consider the adaptation algorithm 


v(k) = D 


'e(A-l)' 

m J 


(16) 


w (k )=4 / ,(v ,B e )B e (^-1)+T 2 (v ,0 e )0, (k -2)+'P 3 (v ,0 r )Q r (k )+T 4 (v ,0 r )0 r (A -1 )+4 / 5 (v ,0 r )0 r (k-2) (17) 


where v(k ) is an nxl vector, D is a constant nxln matrix to be determined, and 
T,(v ,0 e ) T 5 (v , 0 r ) are nxn matrices, also to be determined. In order to ensure that the adap- 

tation dynamics described by (15)-(17) is stable so that the adaptation error approaches zero 
asymptotically, we utilize the Popov hyperstability theory. This theory requires that the dynamic 
equations of the adaptation process be arranged in a feedback configuration. The forward block 
must contain only linear time-invariant dynamic equations while the feedback block can contain 
nonlinear time-varying dynamic equations. In the robot control problem under consideration, the 
forward block has the input w(k), the output v(k ) and is described by (15)-(16). The nonlinear 
feedback block is described by (17). 


According to the hyperstability theory, the adaptation algorithm (15)-(17) is stable in the 


sense that Lim 

k—*o o 


e(*-lj 

m 


= 0 if the following two conditions are satisfied: 


Condition 1 : The transfer function matrix of the forward block H(z) = z D ( zl 2n -C) _1 B is 
strictly positive real (SPR), where C= \ and 5 = 


0 
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k\ 

Condition 2 : The input-output of the feedback block satisfies the inequality J^v 7 (k) w (k) > -f 

k = 0 

for all k\, where y is an arbitrary finite constant and the superscript T denotes the transposition. 

Using proportional plus integral type adaptation for the gain matrices, it is shown in the 
appendix that the following algorithm that satisfies conditions 1 and 2 


P l (k) = P l (k-\) + O e (k)Qj(k-\)E XP + ^(*-l)0j(*-2)[E 1/ -£ 1/ >] (18a) 

P 2 (k) = P 2 (k-\) + 0, (*) ©/(A: -2)E2p +0 e (A:-l)0ja-3)[£: 2/ -£y>] ( 18b ) 

Q{kk) = Q 0 (k-\) + § t (k)Qj(k)F Q p + Q e (k-l) Qj(k-\)[F 0 ,-Fop] (18c) 

Qi(k) = Qi(.k-\) + Q e (k)Q?(k-\)Fip +Q e (k-\) Qj(k-2)[F U -F lP ] (18d) 

Q 2 (k) = Q 2 (k-\) + d e (k)Ql(k-2)F 2J , +e < (*-l)e/(A:-3)[F 2/ -F 2/ >] (18e) 

and 

0 < (A:) = F2 0 «(^- 1 ) + /? 3 0 «(^) (18f ^ 


where Eop Eo/ • - ■ • ’Fip snd F 2 / are SPD adaptation gain matrices and the subscripts P and / 
denote proportional and integral parts, respectively. R 2 and Rj are nxn diagonal matrices whose 
diagonal elements r 2l and r 3 , are obtained from 

r n = «< ^i« h. i + h . «) ^ 19a ^ 

r 3l - = a, (1 +X„ i'=l,2,...,n (19b) 

where a, are positive constants and X u , ^ are the eigenvalues of the error reference model 
chosen such that I X u I <1 , 1 I <1, as explained before. Note that the feedback gains depend only 
on the joint angle error vector, whereas the feedforward gains depend both on the joint angle vec- 
tor and the reference trajectory vector. A block diagram of the adaptive control scheme is shown 
in Figure 1. 

Equations (8), (18) and (19) constitute the adaptation control algorithm. The SPD matrices 

E 0P , E 0/ F 2 p , Fy, the positive scalars a, and the eigenvalues X u , must be specified by 

the designer. A simple structure for the above matrices is the diagonal structure. Furthermore, a 
particularly simple expression for § e (k) is obtained if the eigenvalues of the reference model are 
X i; =X2,=0 , i=l,2,...,rt. This corresponds to the so called "dead-beat control", and in this case 
(180 simplies to 

6 e (k) = R 3 Q e (k) ; R 3 = diag{aJ (20) 

Larger values of the elements of the matrices E 0P ...En and the scalars a, correspond to higher 
adaptation gains and make the errors decay faster. However, if unmodeled dynamics are present, 
high adaptation gains can excite unmodeled dynamics, resulting in instability. Thus the design 
parameters must be selected based on a compromise between speed of adaptation and stability 
considerations. 

It is seen that the adaptive control laws given by (8), (18) and (19) are extremely simple and 
are suitable for real time control. Furthermore the complex robot dynamics or robot parameters 
are not required for the generation of control torques. The adaptation algorithm ensures that the 
closed-loop system remains stable and that trajectory tracking occurs provided the rate of adapta- 
tion of controller gains is higher than the rate of change of robot matrices. For example, the 
matrices of many industrial robots do not change appreciably over time intervals of about ten 
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milliseconds, in which case the controller adaptation time can be a few milliseconds. 


5. Conclusions 

An adaptive control scheme is developed using a general discrete-time model of robot mani- 
pulators. The control scheme utilizes only joint position-velocity measurements and the reference 
position, and does not require knowledge of the payload or the robot characteristics. The adapta- 
tion laws are derived using hyperstability theory which guarantees asymptotic trajectory tracking 
despite gross robot parameter variations. The controller gains are independent of the robot param- 
eters provided that the gain adaptation is sufficiently fast. 

The method offers considerable flexibility in design by providing many free design parame- 
ters. These parameters can be adjusted by the designer to improve the response and to increase 
the speed of adaptation. The discrete-time adaptive control algorithm is extremely simple and 
computationally fast, and is therefore suitable for real time digital control of robot manipulators. 
Extensive computer simulation studies using a model of a direct drive manipulator have shown 
that the discrete-time adaptive scheme performs satisfactorily despite gross payload variations 
and unknown robot parameters. 
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Appendix 

In this appendix, we derive the gain adaptation algorithm (18). Consider Condition 1 and 
write //(z) as 

H{z) = z D (zl 2n -C)-'B =DB +DC (zI-^-CT'B (21) 

Now, H(z) is SPR if the exists 2nx2n symmetric positive definite (SPD) matrices R and M , nxn 
matrix K and 2 nxn matrix L such that [15, Lemma B.4-2] 

C t RC -R=-LL t -M (22) 

B t RC+K t L t =DC (23) 

K T K =(DB) + ( DB f -B t RB (24) 


The problem is to choose the matrices R,M ,K ,L and D to satisfy (22)-(24). Let 


R = 


R 2 


*2 

*3 


R i = diag {r u } , R 2 = diag{r 2i } , R 3 = diag {r v } 


where R\,R 2 and Rj are diagonal nxn matrices whose diagonal elements are r u > 0, > 0 and 

r 3i >0; This particular structure ensures that R is SPD and simplifies the derivations, 

as will be seen. Substituting R and B in (24), we have 

K t K = R\ =Rj 

or K = diag Hr 3i } and thus the matrix K is found to satisfy (24). Next we choose D = (R 2 /? 3 ) 

and substitute for D , B , R , C and K in (23) to obtain L = 0. Thus L is also found and (23) is 
satisfied. Now we consider (22), and in order to obtain explicit relationship between the elements 
of R and the given matrices C and M , we select the following structures 


M = 


M, (T 

0 M 2 


M \ = diag {m u } , M 2 = diag {m 2i } ;m u , m 2i >0 


C = 


0 /„ 

~C 2 ~C l 


C 2 = diag {c 2l } , C ] = diag {c u } 


Substituting for R ,C and M in (22) and solving, we obtain 


m i 2 m, m, 

r li =m li + C2,(l+C2,) , r 2i = C2jCii , r 3l - = — — (1+C 2 , ) 

c, c, c, 


(25a) 


where 


m i =(m u +m 2i )> 0 ; c, = (1— ) (i+c^f-cu 


(25b) 



The characteristic polynomial of the reference model (10) is 

A(z) = y z 2 I„ +C\Z + C 2 ( = 05, (z) (26a) 

' ' i = 1 

where 

5,(z) = z 2 + c ]( z + c 2, =(z+X h )(z+X^) (26b) 

Since the reference model is stable, i.e. I X 1( I < 1 , I I < 1, we must have 

1 8 ,( 0 ) I <1 6 ,( 1)>0 S ,(- 1)>0 


or 


ICftlCl, (1+C j;+C 2i )>0 , ( 1 — c 1 ,• — C 2 / )>0 


(27) 


m \i +m 2i 

Inequalities (27) imply that c, in (25b) is positive. Let a, = 

positive numbers, then using (25) and (26b) we have 
r ii = m i, +<x, (A-i, y^n ) 2 (1+X 1( ) 

r 2i = a i ^li ^2 i (^li +^2i ) 
r 3 i = 


,j=l,2,...,n where a, are 


(28a) 

(28b) 

(28c) 


Note that the acquired r u ,r 2l and r 3l are positive, and thus R lt R 2 , R 3 and consequently R are all 
SPD. We conclude that Condition 1 is satisfied by choosing D in the adaptation algorithm (16) 
as D = ( R 2 R 3 ) where the elements of R 2 and F 3 are given by (28b) and (28c), respectively. 

In order to satisfy Condition 2, we select the matrices 'Fi(v,0 e ) , .... T 5 (v ,0 r ) in (17 accord- 
ing to the following proportional plus integral (summation) adaptation law 


*-1 


^i(v ,0, ) = C , - A o' 1 [A i(* )+P ,(* )J = Gv (* )0,'(Jfc- 1 )E 1P + G £ v (/ )0 e ' (/ -1 )E u 
T 2 (v,0,) = C 2 -AS'\A 2 (k)+P 2 (k)\ = Gv(k )Qj(k -2)E 2 p + G v (/ )0 J(/ -2)E ^ 
T 3 (v,0,) = VUo(*H2o(*)l =Gv(k)Qj(k)F 0P +G2v(/)0 r 7 '(/)F (V 

J t=o 


k - 1 


^(V ,0 r ) = V ,(* )-Q ,(*)J = Gv (k )Q^k-\)F lP + G £ v(/)0/(/-l)F „ 


*-1 


¥5^,0 ,) = V[a 2 (*)-2 2 (*)J = Gv (k )Q?(k -7)F ip + G£v(/)9, 7 (/-2)F 2 , 


(29a) 

(29b) 

(29c) 

(29d) 

(29e) 


where G, E XP ,E U , F 2 p , F v are SPD matrices, and the subscripts P and / denote propor- 
tional and integral terms, respectively. 

Consider the first term in the expression for w(Jfc), i.e. w x (k) given in (14b). Using (29a), we 

have 


Ev^AOvv ,(*)=£ 

k=0 k = 0 


v T (k )Gv (k )Qj(k-\ )E XP Q e (k -1) + v T (k )G £ V (/)©/(/- -1 )E „ 0, (k -1) 


/= 0 


(30) 


It is seen that the proportional term produces two quadratic forms v T (k)Gv(k ) and 
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0 e (^_l) 7 '£ , 1/> 9 t (ik-l) which are both positive for all k> 0. Similarly, it can be shown [15, Appen- 
dix D] that the integral term produces quadratic forms and thus £v r (*)w,(*) >0. Since 
..,w 5 (k) in (14b) and (17) have structures similar to w,(k), we have 

^v T (k)wj(k) >0 ,y=l,2 5. We conclude that Condition 2 is satisfied due to the particular 

*=o 

choices in (29). 

Let us chose G^o 1 , define the change in the gain matrices due to adaptation at time k as 
AP i(k)=P tfyP ^k-l) .... AQ 2 (k)=Q 1 {k)-Q 2 (.k-\), and denote the corresponding changes in the 
robot matrices by AA 0 {k\ A A x (k) and AA 2 (k). Then after simplifications, we obtain from (29) 

A P y(k )+A A iOfc yAA Q (k)C , = v (k -1) Oj(k -2)-v (k ) 0j(/:-l)j E XP -\{k- 1 ) Qj(k -2 )E u (3 1 a) 

AP 2 (k )+AA 2 (k yAA 0 (k )C 2 = v(k- 1) Q?(k -3)-v (k) 0j(*-2)] E& -v(k- 1) Qj(k-3)E U (31b) 

AQ 0 (kyAA 0 (k)=\v(k-l)Qhk-V-v(k)Qj(k)\F 0P -v(k-\)Qhk-l)F 0l (31c) 

<N ^ 

AQ x {kyAA ,(Jfc) = fvOt-1) %J(k -2)-v (k ) 0 r T (*-l)l F XP -v(k-l) $J(k-2)F u (3 Id) 

V + 

AQ 2 (k yAA 2 (k)=\v(k-\) §J(k -3)-v (k ) Q?(k -2)j F ^ -v(fc-l) Qj ( k-3)F v (3 1 e) 

In order to make the controller gain matrices independent of the robot matrices, we assume that 
the changes in the robot matrices is much smaller than the corresponding changes in the gain 
matrices due to adaptation, i.e. 

AP x (k)» AA x (k)-AA 0 (k)C x , . . AQ 2 (k)» AA 2 (k) (32) 

This assumption is valid if the adaptation rate is sufficiently fast or equivalently, if the robot 
matrices are slowly time-varying. The vector v(k) in (31) is obtained from (16) as 

v(k) = R 2 t(k-\) + R 3 e(k) (33) 

which in view of (13) with Q em (k)=0, is 

v(k)-~ (R 2 Q e (k-\) + R 3 Q e (k)) = - 6 e (k ) (34) 

Finally, using (31), (32) and (34), we obtain the gain adaptation laws given by (18). 
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Figure 1 -Discrete-Time Adaptive Control Scheme 





